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Abstract 


To explore effective learning design for students’ cognitive engagement, a design-based 
case study was conducted in a quality control course in the Costa Rican National 
University of Distance Education between the 2011 and 2012 academic years. The 
course was revised for the 2012 provision in terms of the assignment structure, the 
number of face-to-face sessions, and facilitation strategies. This study documents how 
the course redesign impacted the distance learners’ cognitive engagement and learning 
outcomes. Theories of cognitive engagement and transactional distance informed the 
design-based investigation. Research findings indicate that the design revisions 
positively influenced both students’ cognitive engagement and learning outcomes within 
this distance higher education context; however, the student performance represented 
by their assessment grades might not always reflect this improvement. 

Keywords: Distance higher education; transactional distance; cognitive engagement; 
learning outcomes; design-based research 
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Introduction 


Design-based research integrates empirical investigation with theory-based learning 
design (Swan, Mattews, Bogle, Boles, & Day, 2012). The ultimate goal of design-based 
research is to improve students’ learning in real-world educational environments 
through systematic innovations (Wang & Hannafin, 2005). Since research and 
development simultaneously occur through continuous cycles of design, enactment, 
analysis, and redesign in a design-based research project (Cobb, 2001), this approach 
enables educators to elucidate “how, when, and why educational innovations work in 
practice” (The Design-Based Research Collective, 2003, p. 5). Particularly, design-based 
research entails the study of learning in context through systematic design and 
instructional strategies (Brown, 1992). It thus leads to “contextually-sensitive design 
principles and theories” (Wang & Hannafin, 2005, p. 7), which also can create a number 
of meaningful implications for distance education. 

The purpose of this study is to report on the first cycle of a design-based research 
process for designing, implementing, and revising a quality control course in the Costa 
Rican National University of Distance (Universidad Nacional Estatal a Distancia in 
Spanish). Considering the iterative nature of design-based research and the dual 
purpose to redesign the course and to create design principles (Swan et al., 2012; Wang 
& Hannafin, 2005), the study documents the design changes made for the 2012 course 
provision and their effect on students’ cognitive engagement and learning outcomes. 
The target course has been provided at an undergraduate level in a hybrid format; it 
features field trips related to students’ individual research projects as well as a series of 
supplementary face-to-face classes. 

Lauzon (1992) pointed out that one of the fundamental challenges for distance 
educators is to “search out means of reducing structure and increasing dialogue so that 
learners may move from being simply recipients of knowledge to actively embracing and 
working with objective knowledge to make it their own” (p. 34). In an attempt to 
improve the course quality through ongoing design experiment, we attempted to 
determine how the redesign influenced the pedagogical processes and outcomes in this 
specific context of open and distance higher education. The quality control course in the 
Costa Rican National University of Distance Education was chosen for this design-based 
research because the course involved multiple pedagogical elements which might 
illuminate how the changes intended to enhance the course quality influenced students’ 
learning experiences. 

The conceptual framework of the research is described in Figure 1. After reviewing the 
student survey results compiled after the 2011 course, we redesigned the course 
structure and content with two guiding theories of cognitive engagement and 
transactional distance in order to facilitate engagement with learning. More specifically, 
the assignment structure, facilitation strategies, formats of supplementary face-to-face 
sessions, and examination contents were redesigned in the line with the two theories. 


| Vol 15 1 No 6 


Creative Commons Attribution 4.0 International License 


Dec/14 


189 






Promoting Distance Learners’ Cognitive Engagement and Learning Outcomes: Design-Based Research in 

the Costa Rican National University of Distance Education 


Joo, Andres, and Shearer 

Subsequently, we examined the impact of the design changes in terms of the students’ 
cognitive engagement and performance as well as knowledge development. 


Costa Rica National Distance University 

Quality Control Course 



Figure l. Conceptual framework of the research. 


Theoretical Frameworks 


Cognitive Engagement 

Given complex online learning environments, how distance learners engage in a specific 
educational circumstance and attendant instructional materials has been posited as a 
significant research inquiry because learners’ cognitive engagement is pivotal for any 
distance educational pedagogy. Distance learners’ engagement in and/or commitment 
to learning has been examined along with diverse pedagogical issues, such as learning 
effectiveness (Swan, 2003), student satisfaction (Sun, et al., 2008; Shea, Pickett, & Pelz, 
2003), learning motivation (Hoskins & Van Hoof, 2005), and learning strategies 
(Brown, Meyers, & Roy, 2003; Stoney & Oliver, 1999). Cognitive engagement, as a 
theoretical construct, bridges among those heterogeneous conceptions in explicating 
how distance learners experience a learning context while accounting for their 
individual experiences and characteristics (Biggs, 1987). Since “the integration and 
utilization of students’ motivations and strategies in the course of their learning” are the 
key to a successful distance education pedagogy (Richardson & Newby, 2006, p. 23), a 
conceptualization of cognitive engagement in relation to online course design supports 
effective teaching strategies, high learner motivation, and productive distance education 
pedagogy. 
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The term cognitive engagement was first coined by Corno and Mandinach (1983) to 
investigate students’ learning in relation to the pedagogical process as well as individual 
characteristics. As cognitive engagement affects the amount and quality of effort that 
students exert in classroom activities, it indicates the level and/or kind of their 
motivations (Corno & Mandinach, 1983). Corno and Mandinach (1983) further argued 
that self-regulated learning is a representative form of cognitive engagement that leads 
students to a higher level of thinking. The conception of cognitive engagement has been 
used in various areas, such as literacy (Guthrie, 1996), multimedia (Bangert-Drowns & 
Pyke, 2001; McLoughlin & Luca, 2000; Stoney & Oliver, 1999), and mathematics 
(Henningsen & Stein, 2002; Marks, 2000). These primary inquiries encompass 
cognitive abilities, affective motivations, and learning experiences as defining aspects of 
students’ cognitive engagement. 

In the current study, cognitive engagement was regarded as one significant indicator of 
students’ learning motivation in the context of open and distance higher education. The 
students revealed varying amounts and kinds of motivation and strategy in their 
learning tasks. This phenomenon can be further explained along with the distinction 
between deep and surface engagement with their learning (Biggs, 1987; Craik & 
Lockhart, 1972). Deep engagement is associated with intrinsic motive to create a more 
complex knowledge structure by means of one’s existing knowledge and pedagogical 
materials (Biggs, 1987; Kardash & Amlund, 1991). On the other hand, surface 
engagement involves mere memorization, simple reproduction, and other kinds of 
superficial engagement with learning materials, such as just re-reading textbooks or 
class notes (Walker, Greene, & Mansell, 2006). Whereas surface engagement frequently 
results in unmet learner needs or underachievement in learning tasks, deep engagement 
with learning can be embodied in students’ thoughtful cognitive processing and self- 
regulatory strategies (Corno & Mandinach, 1983; Greene & Miller, 1996; Wolters & 
Benzon, 2013). Furthermore, the students’ experience of deep cognitive engagement is 
more likely to influence their future use of meaningful strategies that they develop 
through the learning process (Schunk, 1991). 

In addition to individual motivation, interaction also plays a crucial role in the students’ 
engagement with learning. In most educational environments, a classroom culture has a 
significant impact on the conditions that either restrict or improve certain pedagogical 
strategies and particular types of interaction among the pedagogical subjects (Edwards 
& Mercer, 1987). That is, cognitive engagement of students can be influenced by certain 
teaching strategies and interactions in the educational context (Blumenfeld, Puro, & 
Mergendoller, 1992). Moore (1989) identified three major categories of interaction in 
any pedagogical context: learner-teacher, learner-content, and learner-learner. The 
learning (re)design in this research thus included various strategies to promote 
interaction among the students (e.g., by changing discussion assignments) as well as 
between the students and the instructor (e.g., by increasing the number of face-to-face 
sessions). Interaction between the students and learning content was accounted for 
through variations in lesson units and reading assignment. 
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To this end, the changes made to improve students’ cognitive engagement was assessed 
through course content reviews, such as discussion forums, assignments, and the mid 
and post self-assessments as well as the Cognitive Engagement/Transactional Distance 
(CE/TD) survey implemented at the end of the course. Survey questions particularly 
focused on the themes of e-learning, metacognitive ability, and self-regulation, which 
were specifically intended to capture transactional distance perceived by the students 
and to gauge their cognitive engagement in learning. 

Theory of Transactional Distance 

To further promote various interactions through our course (re)design, the theory of 
transactional distance (or transactional distance theory) was considered. Moore (1997), 
the pioneer of this theory, defined transactional distance as “a concept describing the 
universe of teacher-learner relationships that exist when learners and instructors are 
separated by space and/or by time” (p. 22). Most importantly, the concept of 
transactional distance denotes the psychological, rather than physical, distance among 
the pedagogical subjects. This observation is premised with physical separation between 
individuals that creates “a psychological and communications space to be crossed, a 
space of potential misunderstanding between the inputs of instructor and those of the 
learner” (Moore, 1997, p. 22). One of the fundamental theoretical implications of 
transactional distance is that an educational exchange among the pedagogical subjects, 
which is facilitated by educational mediations, can reduce miscommunication or 
psychological disconnection in order to lead to an effective educational transaction 
(Shearer, 2009). 

In a nutshell, the theory of transactional distance concerns the pedagogical 
phenomenon of interaction between teachers and learners, or among learners 
themselves, in the distance educational context primarily influenced by diverse relations 
between dialogue and structure. More specifically, the structure consists of course 
design elements, such as learning objectives, activities, assignments, and assessments, 
whereas dialogue refers to the meaningful communication between the pedagogical 
subjects. Moreover, the theory accounts for the importance of autonomy, which 
indicates a learner characteristic in line with the degree of self-control or self¬ 
management in learning (Moore, 1997; Shearer, 2009). The theory thus allows us to 
elucidate how relations among the three fundamental variables in distance educational 
settings can “describe the extent to which course components can accommodate or be 
responsive to each learner’s individual need” (Moore & Kearsley, 1996, p. 200). 

Even though Gorsky and Caspi (2005) pointed out that few studies had carried out 
empirical research to test the validity of the theory’s central constructs—dialogue, 
structure, and learner autonomy—a number of empirical studies have recently utilized 
the theoretical framework to scrutinize various pedagogical phenomena in online and 
distance educational settings internationally (e.g., Falloon, 2011; Flowers, White, & 
Raynor Jr., 2012; Hussein-Farraj, Barak, & Dori, 2012; Larkin & Jamieson-Proctor, 


| Vol 15 | No 6 


Creative Commons Attribution 4.0 International License 


Dec/14 


192 




Promoting Distance Learners’ Cognitive Engagement and Learning Outcomes: Design-Based Research in 

the Costa Rican National University of Distance Education 


Joo, Andres, and Shearer 


2013; Shaw & Chen, 2012). Goel, Zhang, and Templeton (2012) re-examined the core 
tenets of transactional distance theory in order to illuminate the congruence between 
the theory’s face and empirical validities. Their findings attest that the theoretical 
underpinnings are empirically valid in explaining the participants’ e-learning 
experiences (Goel, Zhang, & Templeton, 2012). 

At a macro level, transactional distance theory helps us to understand how the three 
variables interact in the context of distance education (Shearer, 2009). As discussed by 
Moore (1980; 1997) and supported by Saba and Shearer (1994) and Shearer (2009), 
transactional distance or psychological separation is diminished when dialogue is high 
and structure is low. However, in the occasion that learners are highly autonomous, low 
dialogue does not necessarily exasperate the transactional distance. These relationships 
imply that a high level of dialogue may not always be required by autonomous learners 
for their effective learning. The relationships among the three variables are visualized in 
Figure 2. 



D = Dialogue 
3 = Structure 
A ~ Autonomy 


D+ 


Figure 2. Three dimensions of transactional distance (Adpated from Shearer, 2009, p. 
17 ). 


In the process of designing a distance education course, Moore (1997) listed six 
fundamental components that could substantially alleviate or aggravate the 
transactional distance: (1) organizing the presentation of information; (2) supporting 
the learner’s motivation; (3) stimulating analysis and criticism; (4) giving advice and 
counsel; (5) arranging practice, application, testing, and evaluation; and (6) arranging 
for student creation of knowledge. These design elements have commonalities in some 
epistemological purviews of cognitive engagement, especially in terms of learning 
motivation and pedagogical strategies. Our research explores connections between 
design and students’ learning experiences through a redesign of the course as guided by 
the two theoretical frameworks. 
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Course Redesign 


To examine the relationship between course design and learning processes/outcomes, 
the research team focused on the review and revision of a hybrid, though mostly online, 
undergraduate course in engineering developed in line with the two guiding theories. 

Educational Settings 

The Costa Rican National University of Distance Education was established in 1977. It is 
a public higher education institution created with a pedagogical model of open and 
distance education within the national university system of Costa Rica. This open and 
distance higher education institution generally requires high school diplomas for 
admission; however, some programs also implement placement tests as they provide 
professional certificates such as the English/French language teacher certificate and the 
industrial engineering professional certificate. Because a majority of the students 
pursue higher education degrees through this open educational opportunity, the 
institution’s chief goal is to help disadvantaged adult groups participating in higher 
education. Approximately 3,000 students in diverse social groups are admitted to the 
institution annually. 

This design-based research was conducted with the Quality Control course that is 
offered in the Agroindustry Engineering program once a year. The overarching course 
mission is to develop necessary skills for students to use key quality control methods 
and statistical techniques as well as total quality standards in a variety of food 
production stages, which leads to constant quality control and improvement. The course 
involves multiple hands-on activities entailing a high level of statistical exercises. 
Communication between the instructor and the students in those class activities are 
very important because students need an effective guide when they face difficulties at a 
distance. The regular quota enrollment of this course is 30. 31 students registered, and 
29 students completed the course in 2011; 26 students registered and completed the 
course in 2012. 

Course Revisions 

The Quality Control course consists of four units (see Table 1). The course generally 
involves four types of evaluation: two exams, case study, a research project (plant tour), 
and participation (i.e., discussion forums and communications). In the case study, 
students are asked to present a problem case that a food factory may confront in its 
production lines, usually related to statistics and control graphs. Students should 
identify specific non-conformities that might cause the problems and provide adequate 
resolutions, using either their own experiences or readings. The case study covered 20% 
of the total grade in both 2011 and 2012. Additionally, students are required to visit food 
factories for their research projects, which is designed to improve their skills in 
identifying and analyzing major problems in real industrial context. The research report 
is expected to clearly demonstrate their observations of the circumstances, specific 
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problems identified, possible solutions based upon statistical analyses, and reflections. 
While 25% of the total grade was allocated to the research project in 2011, 30% of the 
total grade was evaluated by the research project in 2012. 

Table 1 

Course Objectives and Assessments 


Unit 

Objective 

Assessment 

1 

Quality control 
systems: 

Components and 
benefits 

Acquire the basic knowledge 
related to quality control and 
quality assurance according to the 
theories and tendencies applied to 
the food industry. 

• Q/A forum 

2 

Elemental statistics, 
variables, and 
attributes of control 
graphs 

Apply the inferential, descriptive 
statistical concepts, and the quality 
tools that support the 
implementation of a quality control 
and assurance system in a food 
factory. 

• Case study 

• First 

exam (Units 1- 
2) 

3 

Standards and 
norms applicable to 
quality control 

Acquire knowledge about the 
correct application of the different 
normalization systems of a food 
company. 


4 

Quality engineering 
and quality 
administration 

Analyze the quality management 
process in a real situation through 
a visit to a food company. 

• Second exam 
(Units 3-4) 

• Research 
project (plant 
tour) 


After the 2011 course provision, the department decided to redesign the quality control 
course according to two reviewers’ comments 1 and the results of the CE/TD survey. The 
pedagogical issues identified through these review processes are threefold. First, the 
course structure needed a revision as the majority of students pointed out problems that 
stemmed from giving them flexibility to explore broad topics to be covered in the 
course. This problem led us to rethink the amount of knowledge and information that 
students must focus on in their learning. Particularly, for those who had less statistical 
skills and experiences, this problem appeared even more salient. Second, the students 
highlighted the necessity to promote communications between the instructor and 
themselves, especially when they had confronted difficulties with the assignments and 

1 In the Costa Rican National University of Distance Education, lesson materials and 
course outcomes in each course are reviewed and evaluated by at least two administrators. 
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examinations. Some students at a distance requested a video conference with the 
instructor to grapple with this issue. Third, more clearly stated guidelines were 
requested for the assessment activities. In particular, many students reported that the 
instructions for the research project and exams were so ambiguous that the instructor 
should have provided more precise and concrete information. 

Those issues mainly highlighted the needs for improvement in assignments, 
communication, facilitation, and assessment. Thus, the course revisions for the 2012 
version centered on restructuring the reading assignments, increasing the number of 
face-to-face classes, employing facilitation strategies through diverse communication 
channels, and recalibrating the foci of the examinations. The specific changes made 
between 2011 and 2012 are described in Table 2. 

Table 2 

Changes Conducted Between 2011 and 2012 in the Quality Control Course 


Redesign element 

2011 course 

2012 course 

Reading 

assignment 

Students were guided to read 
the entire textbook. 

Students read specific topics in 
the textbook. 

Number of face-to- 
face sessions 

There was one face-to-face class 
during the course. 

There were two face-to-face 
classes during the course. 

Facilitation strategy 

The instructor used no 
facilitation strategies other than 
answering students’ questions. 

The instructor employed 
multiple facilitation strategies 
through diverse communication 
channels (e.g., phone calls, e- 
mails, video conferences, etc.). 

Examination 

Exams included questions 
developed from a wide variety of 
topics in the course. 

Exams were designed to 
measure students’ expertise and 
deep learning in a limited 
number of topics. 


Taken together, the design changes for the 2012 course provision were grounded in the 
two guiding theories of cognitive engagement and transactional distance. The 
improvements were intended to promote the students’ deep engagement in their 
learning and to reduce the transactional distance between the instructor and the 
students. 
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Methodology 


Research Questions 

As noted earlier, the research reported in this study drew upon a design-based approach 
to a Quality Control course in the Costa Rican National University of Distance 
Education. The primary focus of the investigation was comparing learning experiences 
and outcomes of two student cohort groups in 2011 and 2012. The course redesign was 
based upon the cognitive engagement (CE) and transactional distance (TD) frameworks 
for the purpose of promoting the course quality and student learning. The following 
research questions informed the research: 

• Was there a significant difference in the students’ cognitive engagement 
between the 2011 and 2012 cohort groups? 

• How did the course redesign affect the transactional distance and 
student learning outcomes reported by each student group? 

Preliminary Findings 

The preliminary findings of this research included results from the review of the 2011 
course. At the end of the 2011 course, the students’ learning was evaluated by two 
evaluation methods: (1) final course grades based upon student participation, the case 
study, the research project, and two written exams and (2) self-evaluation sent to the 
students in the Moodle platform. Figure 3 describes the range of grades per each 
assessment in 2011. 


Jul ktl 


Discussion 

Forum 


Case Study 


5t Exam 


2 nd Exam Research Proj ect 


Figure 3. Range of grades per each assessment in 2011. 
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Students gained higher scores in the assessments of the forum and the research project, 
whereas they accomplished relatively low scores in the first and second exams. This 
analysis highlights the gap between their motivation or cognitive engagement, which is 
represented by the discussion forum and the research project scores as well as the 
learning outcomes measured by the written exams. Despite the gap, a positive 
correlation between cognitive engagement and learning outcomes was observed; that is, 
the more a student was engaged in the course, the higher scores he/she attained in the 
exams (Spearman’s rho = 0.78). In total, a third of the students obtained final grades 
between 71% and 90% in 2011. 

In 2012, the students were also required to complete an online self-checklist (Appendix 
II) where they were asked to reflect upon the improvement of their knowledge and skills 
in regards to the subject. This self-assessment encompassed three topics (i.e., 
descriptive and inferential statistics, control graphics and other techniques, and 
normalization and quality administration) and 13 yes/no question items. In sum, the 
students marked “yes” on 54% of the question items. 

Data Collection and Analysis 

This design-based research was adapted to explore the effects of course revisions on 
students’ cognitive engagement and learning outcomes. Even though the research team 
used some qualitative data such as reviewers’ comments and course materials in the 
process of this design-based research, the students’ grades, surveys, and self-assessment 
conducted in 2012 were three major methods for data collection and analysis. 

The participants were distance learners in the Quality Control course in 2011 (n = 31) 
and 2012 (n = 26). The research team reviewed both versions of the 2011 and 2012 
Quality Control course, including instructional content as well as student materials (e.g., 
discussions, communications, assignments, exams, etc.). The structural changes made 
for the 2012 course were primarily determined by the review of the 2011 course. 
Learning outcome measures included scores on each assessment method as well as the 
final course grades. On the one hand, the first exam measured students’ learning of 
quality control systems, elementary statistics, and process control graphs, whereas the 
second exam tested their knowledge about standards, norms, quality engineering, and 
quality administration. The case study aimed to assess the students’ abilities to apply 
relevant statistics and process control graphics, and the research project represented the 
course goal of analyzing the quality management process in a real situation. 

In order to evaluate students’ cognitive engagement and experiences of transactional 
distance, all students were asked to complete the CE/TD survey that was composed of 5- 
point Likert questionnaires concerning e-learning, course content and structure, 
facilitation and communication, metacognition and self-regulation, and overall course 
feedback. This survey was initially validated by a previous study (Andres, Menacho, & 
Rey, 2010) that used a Delphi method to select pertinent question items to measure 
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cognitive engagement and transactional distance in the context of distance higher 
education. Additionally, every student in both 2011 and 2012 was asked to submit the 
self-assessment of their knowledge and skills developed through this course. 

A quasi-experimental approach was employed to compare students’ grades before and 
after the course revisions. That is, the revisions were posed as the independent variables 
while the dependent variables were students’ scores in the series of course assessment 
methods. Additionally, a two-sample t test was applied to the CE/TD survey results 
(Appendix I) in order to verify if there was a significant difference between 2011 and 
2012 (p < 0.0001). The students completed a self-checklist (Appendix II) to measure 
their own knowledge development at the end of 2012. The statistical program used for 
the analyses was InfoStat, a free software program last updated on Oct 17, 2010. 


Results 


Given the small sample size, the students’ cognitive engagement measured by the survey 
and learning outcomes measured by their performance in each assessment could not be 
statistically generalized. Nevertheless, descriptive statistics show that students’ 
cognitive engagement and performance were notably improved after the course redesign 
(t (30) =22.09, P < 0.0001). In particular, the students perceived that course content 
and their engagement in the units were significantly improved along with the course 
revisions (Figure 4). 


strongly agree 5 



E-Learning Course Contents Learning Materials Metacognition &. Assessment 

Self-Regulation 


Figure 4. CE/TD survey result. 


In terms of students’ performance, the most contiguous difference was observed in 
Exam 1 and the case study, which supported the revision of the course assignments and 
the increased number of face-to-face sessions. 
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Case Study Exam 1 Exam 2 Research Final 

Project Grade 


■ 2011 

■ 2012 


Figure 5. Student grades before and after course redesign. 


Figure 5 indicates students’ average scores in each assessment between 2011 and 2012. 
Positive influence of the course redesign on the student scores were observed in every 
assessment except Exam 2. The decreased average scores in Exam 2 could be partially 
due to the higher-level statistical analysis required for the 2012 exam. The 2011 exam 
was more theoretical, whereas the 2012 exam had more application-level questions. 

Table 3 

T Test Results and Effect Sizes for Learning Outcomes (in Each Category Including the 
Final Grade, 10 Points Equaled a Perfect Score) 


Assessment 

2011 


2012 


t 

(2-tailed) 

Eta 

Eta- 

Squared 

M 

SD 

M 

SD 

Case Study 

8.33 

17.49 

10.0 

0.00 

22.75** 

.164 

.027 

Exam 1 

3-90 

17.96 

4-85 

14.92 

8.29* 

.041 

.002 

Exam 2 

6.92 

2.09 

6.21 

1.58 

15.74** 

•093 

.009 

Research 

Project 

9-77 

0.41 

10.0 

0.00 

14-53 

.442 

•195 

Final Grade 

6.90 

1-93 

7.10 

2.07 

18.19** 

•253 

.064 


* p < 0.001 and < 0.0001 
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The final grade mean in 2011 was 6.90, with a standard deviation of 1.93. On the other 
hand, the final grade mean in 2012 after the redesign was 7.10, with a standard 
deviation of 2.07. The difference was statistically significant: t(3o) =18.19, p<o.oooi. In 
other words, the 2012 course revisions were effective for assessment performance. To 
this end, the result shows how the revisions oriented toward reducing the transactional 
distance between the instructor and students as well as promoting students’ cognitive 
engagement for the 2012 course enhanced the quality of the course. 

The result of the self-checklist completed by the 2012 students also reflected this 
positive impact of the course redesign. Even though the self-checklist is subjective and 
constructivist by nature, the fact that a majority of the students in 2012 checked off 
most key subject areas of the course as well understood attests to effective facilitation of 
students’ development as intended by the design changes. Over 80% of the students 
answered “yes” to more than 12 out of 16 checklist items, and only 2 student marked 
“yes” to less than 8 questions. Since the self-checklist was not provided to the students 
in 2011, this result is not comparable between the two student cohort groups. 

In summary, the improvement of the learning processes and outcomes measured by the 
CE/TD survey and the checklist assessment suggest that interventions aimed to enhance 
students’ cognitive engagement as well as reduce the transactional distance led to 
positive learning processes and outcomes in this open and distance higher education 
context. Therefore, these design-based research findings seem to correspond to the 
theoretical assumptions of cognitive engagement and transactional distance. 


Discussion and Conclusion 


Linking online learning design to students’ motivation and learning outcomes is a 
persistently significant quest for distance education researchers and scholars. To further 
develop our knowledge regarding these constructs, this study attempted to measure the 
impact of the course redesign in terms of cognitive engagement and transactional 
distance as experienced by distance learners in an institution of open and distance 
higher education. Results of the study indicate that, taken together, the revisions based 
upon the theories of cognitive engagement and transactional distance could be linked to 
the improvement of students’ motivation and learning outcomes. 

This finding suggests a need to consider the specific implications of the range of 
educational contexts in which learning in distance higher education takes place. The 
theory of transactional distance (Moore, 1980) was employed to examine the 
educational context, especially by accounting for the multiple relationships between 
learners or between teacher and learners. More specifically, the study exemplifies that 
the changes in the facilitation strategies and the increased number of face-to-face 
sessions could lead to improved dialogue, which results in the reduction of psychological 
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distance among the pedagogical subjects and the students’ cognitive engagement in this 
distance higher education context. 

Furthermore, the 2012 revisions oriented toward clarifying learning tasks by changing 
the structure enhanced learning outcomes. This result might contradict the theoretical 
assumption of transactional distance, which is grounded in the inverse relation between 
dialogue and structure in a distance education course (Dron, Seidel, & Litten, 2004). 
However, as Moore (1977) previously noted the possibility of high dialogue and high 
structure (as in correspondence programs) or low dialogue and low structure (as in self- 
directed independent programs), the desired balance between dialogue and structure is 
only reliable when it is based on the educational sophistication of the learner and the 
subject content (Moore, 1997). Given the learner characteristics (i.e., mostly part-time 
distance adult learners and transitioning or returning college students) and the subject 
content that requires high-level statistical skills and hands-on exercises in the current 
research, the heightened level of the structure in lessons, assignments, and assessments 
of the 2012 course had a positive impact on dialogue, which made students feel less 
transactional distance. 

More significantly, “[a] delicate balance between course structure and dialogue of the 
instructor and learners is critical for online learner success” (Murphy & Cifuentes, 2001, 
p. 298). Previous studies that investigated the role of course structure in student 
satisfaction and perceived learning in online learning environments, such as Shea, 
Pickett, and Pelz (2003) and Stein, Wanstreet, Calvin, Overtoom, and Wheaton (2005), 
also support reduced transactional distance with high structure and high dialogue. By 
tightening the structure, the course redesign consequently promoted the level of student 
motivation and adaptability of content, which resulted in deeper cognitive engagement 
and richer learning outcomes among the student group. 

To sum up, this design-based research reaffirms the strong correlation of less 
transactional distance with productive learning outcomes recently attested by Benson 
and Samarawickrema (2009) and Flowers, White, and Raynor (2012). Specifically, this 
study implies that the learning context for distance higher education is highly 
dependent on the learning design delicately prepared to support learners’ 
characteristics as well as dialogue. Since an effective instructional systems design model 
considers various aspects of the learning context, such as process, systems, outcomes, 
and delivery (Morrison, Ross, & Kemp, 2010), transactional distance in relation to those 
heterogeneous design elements can inform future design-based research studies that are 
similar in context to the one examined in the current research. To this end, drawing 
upon the lessons that we have obtained through the first cycle of this design-based 
research, we will investigate how the combination of those multiple pedagogical 
components can be optimized to reduce the transactional distance in this specific 
context of open and distance education in the next cycle of course redesign. 
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Appendix A 


Quality Control Course CE/TD Survey 


Name: 

Date: 


Questions asking about your experience of this distance education course are 
categorized into five topic areas as below. Please provide your answers to the questions. 

*1: Strongly Disagree, 2: Disagree, 3: Neutral, 4: Agree, and 5: Strongly 
Agree 


Topic 

Question 

1 

2 

3 

4 

5 

E-Learning 

This online course was more useful than face-to- 
face courses. 






This online course was more convenient than 
face-to-face courses. 






The amount of instructional presentation was 
appropriate. 






Intervention of the instructor through the 
course was timely appropriate and useful. 




— 

— 

I could easily find any necessary information in 
the lessons. 




I always have access to this online course during 
this semester. 






It was easy for me to use the virtual platform of 
this course. 






I prefer working on and submitting assignment 
and assessment online to doing them in hard 
copies. 






The communication through the platform e-mail 
was seamless. 






Course 

Contents 

Course contents met my expectations and needs. 






Exams were adequately designed to assess my 
learning. 






The difficulty-level of course contents were 
appropriate. 






I would use knowledge and skills that I learn 
from this course. 






Learning 

Materials 

The study guideline was useful for my learning 
experiences in this course. 






I could easily understand the textbook contents. 






I could easily understand what the online course 
materials indicate without further explanations. 






Metacognitio 
n & Self- 
Regulation 

I was motivated to further explore challenging 
concepts and problems in the course. 






A series of assignments and exams facilitated 
my knowledge development. 






The instructor’s advice and tutoring effectively 
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led to productive and authentic learning. 






Learning took place in a self-paced fashion. 






I managed well to balance my work or everyday 
life and learning in this course. 






Assessment 

The discussion forums were useful for my 
learning. 






The case study helped me to integrate concepts 
and ideas in the lessons. 






Through the research project, I could develop 
my analysis skills. 






The difficulty level of the exams were 
appropriate. 
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Appendix B 


Quality Control Course Knowledge Self-Checklist 

Name: 

Date: 


Objective 

Item 

Yes 

No 

1 

Inferential & 

Descriptive 

Statistics 

1-1.1 can define what a quality control system 
is. 



1-2 .1 can list the fundamental factors of Quality 
Control. 



1-3 .1 can specify benefits that a Quality Control 
system brings. 



1-4.1 can apply basic statistical concepts (such 
as a “z” contrast test and a variance analysis) to 
Quality Control practice. 



2 

Control 

Graphics & 

Other 

Techniques 

2-1.1 can create control graphics with different 
variables. 



2-2.1 can build control graphics using key 
attributes. 



2-3.1 can interpret the control graphics. 



2-4 .1 can make Ishikawa diagrams. 



2-5.1 can make cause-effect diagrams. 



2-6.1 can interpret ladder diagrams. 



2-7 .1 know how to use Codex Alimentarius 
Normative. 



2-8.1 can define quality specifications. 



3 

Normalization 
& Quality 
Administration 

3-1.1 can articulate principal norms related 
with Quality control of agro industrial food. 



3-2.1 can carry out sampling in an effective 
fashion. 



3-3.1 can explain various aspects of quality 
administration in different contexts. 



3-4.1 can keep a product from being out of 
specifications. 




© Joo, Andres, Shearer 

Athabasca University^ 



This work is licensed under a Creative Commons Attribution 4.0 International License . 


| Vol 15 | No 6 


Creative Commons Attribution 4.0 International License 


Dec/14 


210 










































